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Abstract 

Making statistical predictions requires tackling two problems: one 
must assign appropriate probability distributions and then one must cal- 
culate a variety of expected values. The method of maximum entropy is 
commonly used to address the first problem. Here we explore its use to 
tackle the second problem. We show how this use of maximum entropy 
leads to the Bogoliuvob variational principle which we generalize, apply 
to density functional theory, and use it to develop a mean field theory for 
classical fluids. Numerical calculations for Argon gas are compared with 
experimental data. 

1 Introduction 

The method of Maximum Entropy (ME) has been designed to solve the general 
problem of updating from a prior probability distribution to a posterior distri- 
bution when new information in the form of a constraint becomes available Q . 
The method reflects the deep conviction that one should not change one's mind 
frivolously, that whatever was learned in the past is important. Indeed, this 
concern for prior information is the only guarantee that the new information it- 
self will not be easily discarded in the future. The chosen posterior distribution 
should coincide with the prior as closely as possible: one should only update 
those aspects of one's beliefs for which hard new evidence has been supplied 

i-i- 

The purpose of this work is to explore the use of the ME method as a means 
to tackle problems of a very different kind. The assignment of a probability 
distribution that faithfully codifies our state of knowledge is only a first step 
towards answering our questions about a physical system. There is a second and 
crucial step that requires us to extract the desired answers from the probability 
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distribution. It is not enough to write down a probability distribution, we must 
also be able to read it, to figure out what it means, what it implies. We must 
be able to calculate the expected values of whatever quantities happen to be 
of interest to us. This is a difficult practical problem for which no solution 
of universal applicability is known and, accordingly, a wide variety of different 
techniques, both analytical and numerical, have been developed. 

The approach we explore here consists of approximating the 'exact' distri- 
bution by a more tractable one. Then, the question is: given a family of trial 
tractable distributions, which one should we select? Which distribution within 
the given family best approximates the exact one? When phrased in this way it 
is clear that this is the kind of question that can be tackled using the method of 
ME: one must select the trial distribution that reflects the least misrepresenta- 
tion of our state of knowledge. More specifically, the chosen distribution should 
be that which maximizes the appropriate relative entropy. 

The purpose of this work is to explore the use of ME as a method to gen- 
erate approximations. As a simple illustration, in section 2, we apply the ME 
method to canonical Gibbs-Boltzmann distributions. The resulting variational 
technique, when expressed in terms of the free energies, is recognized as the Bo- 
goliuvob variational principle Q . This is a well known technique for generating 
mean field approximations for discrete systems on a lattice. What is perhaps 
not as widely known is that the Bogoliuvob principle is just another application 
of the ME method (however, see [§)). 

In the bulk of the paper we explore the use of the ME method to generate 
mean field (MF) approximations for classical fluids. Ever since the pioneering 
work of van der Waals many different versions of MF theories have been pro- 
posed and it is not always clear what they have in common - except perhaps for 
neglecting correlation effects. It appears that none of these versions have been 
derived as a systematic application of the ME method. 

The study of classical fluids is an old and mature field. There exist extensive 
treatments in many excellent books and reviews H . Our goal here is not so much 
to contribute to the study of the fluids themselves but rather to use this well- 
explored but still non-trivial field as a testing ground for further development 
of the ME method. In future work we intend to build on our current results 
and extend the method to generate other more sophisticated approximations 
involving canonical transformations to collective coordinates; only then do we 
expect to obtain significantly new contributions to the theory of fluids. 

The study of both homogeneous and inhomogeneous fluids is currently best 
approached using density functional methods [[Io| |lf[ [[l2| which have been noted 
to show a remarkable formal similarity to statistical thermodynamics jl3]]. In 
section 3 we show that the resemblance goes beyond a mere accident: density 
functional methods constitute a generalization of the Gibbs grand canonical 
ensemble to the case of a spatially dependent chemical potential. The resulting 
'density' distribution is, however, too complicated for actual calculations and 
approximations are needed. In section 4 the MF approximation for the density, 
various thermodynamic potentials and pair distribution functions is derived. 
Following an idea due to Percus pi , a second, somewhat improved MF estimate 
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of the two-particle distribution of a homogeneous fluid is obtained by expressing 
it in terms of the one-particle distribution of the fluid placed in a suitable 
external potential. An explicit comparison with experimental data for Argon is 
carried out in section 5. This serves both to determine the parameters of the 
Lennard- Jones potential used to model the interaction between Argon atoms 
and to explore the limitations of the MF approximation. Conclusions and final 
comments appear in section 6. 

2 Maximum Entropy as an approximation tech- 
nique 

Let the microstates of a system (for example, its location in phase space or 
perhaps the values of spin variables) be labelled by coordinates q, and let us 
assume that the probability that the system is in a microstate within a particular 
range dq is given by the canonical distribution 

P(q)dq = — dq where Z = eT^ F = / dqe~ 0H ^. (1) 

In principle knowing the distribution P we should be able to answer any ques- 
tion we might care to ask but in practice complications arise. Any realistic 
Hamiltonian H (q) will usually include complicated non linear interactions that 
make the task of calculating expected values or most other integrals over P 
impossibly difficult. 

A possible way around this problem consists of replacing the 'exact' distribu- 
tion P by another more tractable distribution Pq that approximately represents 
the same state of knowledge. This is perhaps too much to ask for. What we 
really want is a distribution Pq that approximately represents those aspects of 
the information in P that happen to be relevant to those very few, very specific 
questions that we are actually asking. 

The practical problem of choosing a Pq is dealt with in two steps. First 
we search for a family of trial distributions that are simple enough that actual 
calculations are feasible and that we have some reason to suspect might codify 
the appropriate relevant information. This step is the difficult one because there 
is no known systematic procedure to carry it out; it is a matter trial and error 
guided by intuition. The second and easier step is to select the one member 
within the trial family that best resembles the exact P. This step is easier 
because there exists a systematic, mechanical procedure to be followed. As 
discussed in || (and other references therein) there is a unique selection criterion 
satisfying natural desiderata of consistency and objectivity: the distribution to 
be selected is that which maximizes the entropy of Pq relative to P, 

S[P ,P] = -J dqP Q (q)\og^. (2) 

The success of the whole method hinges crucially on the first step, the choice 
of the family of trial distributions. To increase the likelihood that important 
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relevant features {e.g., symmetries or dominant interactions) are not left out it 
is usual - but not necessary - to select trial distributions that could conceiv- 
ably model an idealized system. Such trial distributions are also canonical but 
with a modified Hamiltonian Ho(q;a) where a are parameters labeling each 
distribution within the family, 

„-/3Ho(q;ot) r 
P (q;a)dq = dq where Z (a) = e - pFo{a) = / dqe- f3Ho( ~ q ' a K 

(3) 

Substituting into eq.(g) gives, 

S[P ,P] = /3((H -H) -F + F) , (4) 

where (. . .}q refers to averages over the trial P$. The inequality S[Pq,P] < 0, 
can then be written as 

F < F + (H — H ) a . (5) 

Thus, one selects Po(q; a) by maximizing S over all values of a or equivalently by 
minimizing the quantity Fq + (H — Hq)q. This alternate form of the variational 
principle and its use to generate approximations is well known. It is usually 
associated with the name of Bogoliuvob and it is the main technique to 
generate MF approximations for discrete systems of spins on a lattice. What is 
perhaps not as widely known is that the Bogoliuvob variational principle is just 
a peculiar application of the ME method. 

After this brief formal illustration we are ready to tackle the problem of 
fluids. 



3 The canonical 'density' ensemble 

Many of the most interesting questions we ask when discussing fluids can be 
addressed once we know the density of the fluid under various experimental 
conditions. Examples include the transitions between the gas and liquid phase, 
the structure of the gas-liquid interface, surface tension and capillarity effects 
and so on. We therefore would like to have a formalism where the (possibly 
nonuniform) density n(r) appears as an explicit variable. It is very easy to do 
this, just find the probability distribution that maximizes entropy subject to 
constraints on the expected energy and on the expected density. The result- 
ing distribution is a generalized canonical ensemble we will call the 'density' 
ensemble. 

The logic of the previous paragraph may sound unfamiliar and require fur- 
ther comments. When justifying the use of the ME method to obtain the canon- 
ical Boltzmann-Gibbs distribution (P q oc e~@ Eq ) one might say something like 
"we seek the minimally biased (i.e. maximum entropy) distribution that codifies 
the information we do possess (the expected energy) and nothing else" . Many 
authors - even those who fully appreciate the value of the concept of entropy in 
inductive reasoning - find this justification unsatisfactory. Indeed, they would 
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argue, for example, that the spectrum of black body radiation is what it is in- 
dependently of our knowledge. We prefer to phrase the objection differently: in 
most realistic situations the one thing that is not known is the expected energy, 
and even then one still makes correct predictions by maximizing entropy subject 
to a constraint on the (unknown) expected energy. But then, how can we justify 
the imposition of such 'unknown' constraints in the ME method? 

We propose here that the motivation behind imposing a constraint on the 
expected energy should not be that this is a quantity we happen to know - 
because we do not - but rather that we recognize the expected energy as the 
quantity we need to know. We recognize that in many experimental situations 
the expected energy, even if unknown, is the crucial quantity that codifies the 
relevant information and we proceed to theorize as if we knew it. All resulting 
predictions will contain the temperature as a free unknown parameter. Later, 
when it comes to actually comparing theoretical predictions with experimen- 
tal data we expect that part of the data analysis will consist of adjusting the 
unknown temperature parameter to provide the best fit to the data. In other 
words, the information on expected energy or temperature is something to be 
obtained from the experiment itself. 

Thus, the motivation behind imposing a constraint on the density is not that 
it is something we know, but rather that it is what we should know; it is the 
quantity that codifies information that is very relevant for most questions of 
interest and therefore it is important that it appear explicitly in the formalism. 

The probability that the fluid is composed of N particles with positions and 
momenta within the phase space volume dqN at the location qn = {pi,n; i = 
1, TV} is given by 

P(q N ;0,\)dq N (6) 



where 



1 N 

d ^ = ^ll^ri, (7) 



N\h 3N 



and 

P(q N ;P,\) = |exp-/3 



H(q N ) + J d 3 r A(r)n(r) 



(8) 



where A(r) are Lagrange multipliers that enforce the constraint on the expected 
density (n(r)) at each point in space and the density is 



N 

II ( 



i(r)=£<f(r-rO. (9) 
H(qiv) is the Hamiltonian, 

N 2 N N 

H ^ = E £ + E «(»■«) + E «(»•*) . ( 10 ) 

i—l i>j i—1 
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where = r, — rj, ufaj) is the two-body intcrparticle potential, and v(r) is 
an external potential. The partition function is 



Z{T,\)=Y j fdq N cxp-/3 H(q N )+ [ d 3 r X(r)n(r) 

N=0 J I J 



def e -{M(T,\) , (11) 



where we introduced the thermodynamic potential 0(T, A), a function of the 
temperature T = 1//3 (units arc such that ks = 1), and a functional of A(r). 

The interparticlc and the external potential energies can be rewritten in 
terms of the density 

N N 

' d 3 r v{r)h(r) , (12) 



^ v(ri) = / d 3 r u(r) <5(r - n) = t 
i=i i=i ■* •* 



and 

N N 

U = J2u(r ij ) = 2E U ^) = 2 / d3rdV "(r-r'JnW^r'), (13) 

where n^ 2 \r,r') is the two-particle distribution, 

^(2) ^ _ ^ r _ r ^ j^y — r .} = fi(r)n(r') — h(r)5(r — r') . (14) 

We remark that a constraint on (n(r)) also constrains the expected number 
of particles 

(N) = [ d 3 r{n{r)). (15) 



Therefore the density ensemble is a generalization of the grand-canonical en- 
semble. Indeed, when A(r) is a constant the density distribution reduces to the 
grand-canonical distribution and —A coincides with the chemical potential fi. 

Notice also that the effects of the Lagrange multiplier field A(r) are indis- 
tinguishable from the effects of the external potential v(r). Similarly, when 
two-particle correlations {n^ 2 \r,r')) carry relevant information we might want 
to develop a formalism where they appear explicitly. The effects of the corre- 
sponding Lagrange multipliers are indistinguishable from those of the two-body 
potentials u(r,r'). Perhaps this is the ultimate reason why potentials in gen- 
eral are valuable in physics: they establish control over the relevant physical 
quantities, the density, and the two-particle correlations. 

The expected value of the density is 

W) = |)"«W, (16) 

and the entropy is 

S i p ] = -H I dq N PlogP = -^ (17) 
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These two equations can be combined into 



dn = -SdT + J d 3 rn{r)5\{r). (18) 

To achieve a formulation in terms of the density n(r) rather than the mul- 
tiplier A(r) we consider the Legendre transform 

$[T, n] = fl[T, X]- J d 3 r \(r)n(r) , (19) 

d$ = -SdT - J d 3 r X(r)5n{r) . (20) 

The density functional formalism of Hohenberg and Kohn |l(| is founded 
upon a theorem proving the existence of a functional $[T,n] that is indepen- 
dent of the external potential v(r). From the perspective afforded by the ME 
approach the independence of 3>[T, n] on the potential v(r) is a triviality achieved 
by construction - through the Legendre transform - and their truly nontrivial 
insight is the recognition of the density as the correct choice of relevant variable. 



so that 



4 Mean field approximation 
4.1 MF trial distributions 

We want to approximate the 'exact' probability distribution by a more tractable 
trial distribution in which the interparticle interactions U are replaced by an 
interaction with an external potential, the mean field. The problem consists of 
selecting the best trial distribution, that which best approximates the exact dis- 
tribution. The drastic approximation being made is the neglect of two-particle 
correlations induced by the interparticle potential. 
The trial MF distribution is 



Ho(q 



N) 



d 3 r X(r)h(r) 



(21) 



where 



N 2 r 



(22) 



where vo(r) is the mean field to be determined. 

First we compute several thermodynamic quantities of interest. It is con- 
venient to absorb the external potential v(r), the mean field vo(r), and the 
multiplier field A(r) into a single potential V(r), 



V(r) = v(r) +v (r) + A(r) . 



(23) 
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The partition function Z§ is 

d 3 p R ™ 2 

N=Q 

so that 

1 



N 



drf e -0Q o (0,X) 



Oo[T, A] 



/3A 3 

The expected density is 
or 



d 3 r e~ ,3y(r) where A 



2 \ V2 



y 2nm 



sn 



sa 



def 



5\(r) SV(r) 

p -fW(r) 

no(r) - 



n (r) 



A 3 



(24) 
(25) 

(26) 
(27) 



4.2 ME optimization of the mean field 

Within the family of trial MF distributions the one that is closest to the canon- 
ical density ensemble is that which maximizes the relative entropy 



OO p 

S[P Q \P] =~J2 dq N P (q N \(3,X,v )\og 
N=Q'' 



P (q N \/3, A, vq) 



P(q N \f3,\) 



Substituting Eqs.(§) and (|l|) we obtain 

s[p \p] =0[n-no- {H-H a ) ] 



(28) 



(29) 



(The subscript in (• • • )o indicates the averages are computed over the trial 
distribution Pq.) Since S[Pq\P] < 0, we have 



n[T,A] < Slu[T, A, v ] d = Cl + (H-H ) 
= flo + {U) - / d 3 rv (r)n (r) , 



(30) 
(31) 



and maximizing S[Pq\P] is equivalent to minimizing f2[/ over all mean fields vo. 
The MF approximation to fl, denoted Ct, is defined as the best Ujj, 



fl[T, A] w n[T, A] d = mmnu[T, A, u ] . 
To calculate the potential energy (U)o use Eqs.([l|) and @ 
(C7)o = ^ f d 3 rd 3 r' u(r - r')^ 2) (r, r') , 



(32) 



(33) 
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4 2) (r, r') = (nW(r, r'))o = (n(r)n(r')) - n (r)S(r - r') , (34) 



where 



furthermore, from Eq.(|2l|) and (]2£ 

(h(r)h(r')) = n (r)n a (r') + n (r)S(r - r') . (35) 

Therefore 

n 2 \r,r') = n (r)n (r'), (36) 

and the result for (U)q is 

(U) = ^J d 3 rd 3 r' u{r - r / )n (r)n (r') . (37) 
The best choice of mean field vq (r) is given by 

= jrTT = = M r ) - / dV < r - r ')Mr')] (38) 

dv [r) dV(r) [ J 

where the multiplier A(r) and the external field v(r) are assumed fixed and we 
used Eqs.(|3l|) and (|27|), Therefore, the best mean field, which we will denote by 
v(r) is a function of the temperature T and a functional of the multiplier A(r) 
and the external field v(r), 

v = v[T,X,v], (39) 

defined by the equation 

v(r) - J d 3 r' u(r - r')n {r) = , (40) 

where no is a function of v, 

dot e^ 139 ^ - dof 

noir) = — — and V(r) = v(r) + v(r) + A(r) . (41) 
A J 

To summarize, the MF approximation to the exact thermodynamic potential 
is given by 

Q[T, A, v] = n + U - J d 3 r v(r)n (r) (42) 

where 

n = ~Jd 3 rn (r), (43) 

0q = IJ d3rdV " (r ~ r '^o(r)n (r') , (44) 

and v(r) is given by Eq.(|4^). Throughout we will use overbars to denote quan- 
tities evaluated in the MF approximation. 

Notice that in replacing the exact distribution P by the approximate Pq 
we are not quite replacing the fluid described by the Hamiltonian H by a dif- 
ferent fluid described by Hq: we compute the expectation of the exact H in 
the approximate Pq rather than the expectation of the approximate Hq in the 
approximate Pq. 
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4.3 Density in the MF approximation 

Entropy and density are obtained as derivatives of the thermodynamic potential, 



-SdT 



d 3 rn(r)5\(r) 



Using Eq.(40) and ( [4l| ) the density n(r) is given by 



n(r) 



5tt 
SXOr) 



no(r) 



-pv(r) 



(45) 



(46) 



This permits us to interpret Eq. (|40|) as a self consistency equation: the mean 
field v(r) is generated by a molecular distribution described by the density n(r), 
while the molecules distribute themselves according to the mean field. 
The Legendre transform of f2[£, A], 



$[T, n] =n[T,X]- J d 3 r X(r)n{r) . 
gives the MF approximation to the density functional, 



(47) 



*[T,n] 



d 3 r n(r) [T (log A 3 n(r) - l) + v(r)] 



+ ^ / d 3 rd 3 r' u(r - r')n(r)n(r') . 



(48) 



The density n(r) in a given external potential and multiplier fields is determined 

by 

= -A(r), (49) 



or 



logA 3 n(r) = -/3 



Sn(r) 



v(r) + A(r) + / d 3 r' u(r - r')n(r') 



(50) 



which is clearly equivalent to Eqs.(^Tj) and (H). 

If the only constraint on the density is a constraint on the expected total 
number of particles then the multiplier field A(r) is a constant which we set 
equal to minus the chemical potential. Therefore, 



Tlog A 3 n(r) + v(r) + / d 3 r' u(r - r')n(r') = fi . 



(51) 



We can either consider this equation as determining the chemical potential given 
the density, or alternatively, it determines the density for a given chemical po- 
tential. 
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4.4 Correlation functions — General 

First we recall some standard definitions. Density correlation functions are given 
by derivatives of the partition function Z[T, A, v] with respect to \(ri). Deriva- 
tives of the thermodynamic potential fl[T,X,v] yield the so called 'connected' 
correlation functions; the first is the expected density itself, 

n(r) t { (n(r)) = . (52) 

The second is the density fluctuation correlation, 

dcf 



G (2 \ ri ,r 2 ) ^ ((n( n ) - n(n)) (n(r 2 ) - n{r 2 ))) 

-l s 2 n -iSn(n) 



(53) 



13 5X( ri )SX(r 2 ) (3 SX(r 2 ) 
Using 

n {2) {r u r 2 ) = (n (2) (r 1; r 2 )> = (n(n)h(r 2 )) - n(ri)5(ri - r 2 ) , (54) 

G< 2 > can be reexpressed as 

G^ 2) (ri, r 2 ) = n^ 2 ^(ri,r 2 ) + n(ri)6(ri - r 2 ) - n(ri)n(r 2 ) . (55) 

To introduce the direct (or one-particle irreducible) correlations define 
as the inverse of G( 2 ), = [G (2) ] _1 , 

d 3 r 3 G( 2 )(r!, r 3 )r< 2 )(r 3 , r 2 ) = 5{ n - r 2 ) . (56) 



Therefore, using Eq.(53) and the chain rule, 

^Xn,r 2 ) = -^ = 8 . 6 \* .. . (57) 
on(r 2 ) dn(ri)dn(r 2 ) 

From Eq.(E8|) we see that for an ideal gas we have 



r (2)/ \ s ( r i ~r 2 ) 

rid(ri ' r2) = ^r- (58) 



The difference between F^ 2 ) and T$ is attributed to the interactions and defines 
the direct correlation function c, 

r»( n ,ni) = ^-^-c(r 1 ^). (59) 
n(ri) 

It is convenient to introduce the pair-distribution function g[r\,r 2 ) 

n (2) (ri,r 2 ) = n(ri)n(r 2 )g(n, r 2 ) . (60) 
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Substituting this and Eq.(|55j) into Eq.(|56|) gives 

g{ri,r 2 ) = 1 + c(ri, r 2 ) + / d 3 r 3 n(r 3 )c(r 3 ,r 2 ) [g(ri, r 3 ) - 1] . (61) 



This is called the Oernstein-Zernicke equation. Notice that there is no physical 
content to the OZ equation; it follows exactly from the definitions of T^ 2 \ c and 
g. This concludes our brief summary of definitions. 

At high fluid densities there is data from x-ray and neutron diffraction ex- 
periments that gives the radial distribution g(r) directly. At low densities the 
experimental data is less direct. The data that will be discussed below is derived 
from the virial expansion to the equation of state, in particular the second virial 
coefficient, and from measurements of the internal energy of the fluid. 

For a homogeneous, isotropic fluid of bulk density N/V = rib the equation 
of state is given in terms of g{r) by Q 

P _ 1 nb /"j3„„^ U ( r ) 



cfrr v ' g(r) . (62) 



ribkT 6kT J dr 

Using eq.(|i~3|) and ([30|) the internal energy is 

E=^NkT+(U) (63) 

where, setting the external potential v(r) equal to zero, the potential energy per 
particle is 

{ ^ = ^Jd\u{r)g{r). (64) 

4.5 MF approximation to g(r) 

The MF approximation to the density-fluctuation correlation is obtained using 
Eqs.© and @, 



G (2) (n,r 2 ) = n(n) 



— — — + 5{n - r 2 ) 

d\(r 2 ) 



(65) 



The functional derivative on the right is obtained from the selfconsistency equa- 
tion defining the mean field v, Eq.@. The expression for r^ 2 ^ is much simpler 
and can be written in closed form, 

f( 2 )(n,r 2 ) = 6 ±iplBl +J 9 u (n-ra). (66) 
n(ri) 

Therefore the direct correlation function is 

c(ri,r 2 ) = -0u(rt - r 2 ) . (67) 

Using this expression for c in the case of a homogeneous, isotropic fluid of bulk 
density rib in the OZ equation (|6l|), gives 

g(r) = 1 - f3u(r) - [3n b [ d 3 ru(r') [g(r - r') - 1] , (68) 
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where we have set r-2 = 0. This is the integral equation that must be solved to 
obtain g(r) for each T and rib. 

4.6 An improved MF approximation to g(r) 

The approximation in which each particle moves in a MF held generated by all 
the others is too drastic. One can obtain a somewhat better approximation - 



still of the MF type - by using an elegant argument due to Percus |14 . The 
strategy is to write multiparticle distribution functions for a fluid in terms of the 
single particle density of the same fluid placed in a suitable external potential. 

The idea is simple and revolves around the product rule for probabilities. 
The probability P(r)d r that a particle is found within d 3 r at r is obtained from 
Eq.(^|) by marginalizing over the remaining N — 1 particles, 

P(r) = (S(r - n)) d = n(r\v) , (69) 

i 

where the average is taken with the exact distribution, Eq.(||), and for later 
convenience the dependence on the external potential v is indicated explicitly. 
Similarly, the probability that one particle is found at r and a second one at r s 
is given by P^ (r,r s )d 3 rd 3 r s with 

P(r,r s ) = (J2 <5(r-r,)5] 5(r s - r,-)) = n^(r,r s \v). (70) 

i j^i 

The product rule gives 

P(r,r s )=P(r s )P(r\r s ), (71) 

but 

JV-l 

P(r\r s ) = N(Y / S(r-n)5(r s -r N )) = n(r\v s ) (72) 



is exactly the one-particle distribution of a fluid in a modified external potential, 
Vs(r) = v(r) + u(r — r s ). Therefore, 



and using 
we get 



n (2) (r, r s \v) = n(r s \v)n(r\v s ) , (73) 

n (2 \r,r s \v) = n(r\v)n(r s \v)g(r,r s \v) , (74) 

g(r,r s \v) = (75) 
n[r\v) 

This is exact and can be trivially generalized to multiparticle distributions. 

Now we return to the MF approximation. If there is no external potential, 
v(r) = the fluid is homogeneous and isotropic with a density nj,. We single 
out one molecule located at r s and treat it as special. Since the system is 
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homogeneous n(r\v = 0) = n*. The remaining molecules are effectively moving 
in the external potential v s (r) — u(r — r s ) due to the special molecule. The 
density n(r\v s ) at location r is given by Eq.(^TJ), 



Tlog A 3 n(r\v s ) = \i — u(r — r s ) — I d 3 r' u(r — r')n(r'\v s ) 



(76) 



On the other hand, given n&, the chemical potential is determined from a similar 
equation with the external potential set to zero, 



Tlog A 3 n b = n— \ d 3 r' u(r - r')n b . 
Subtracting these two equations gives 



(77) 



Tlog 



n(r\v s 
n b 



-u(r — r s ) — rib d r' u(r — r') 



n(r'\v s ) 



is 



(78) 



Therefore, setting r s = 0, the MF approximation to Eq. 

g s (r) = cxp (-0u(r) - (3n b J d 3 r' u(r') [g s (r - r') - l] \ . (79) 

We have described two MF approximations to g(r\v). The first requires 
solving Eq.(|68|) for g(r). The second is an improved MF approximation, which 
does include some correlation effects, is obtained by solving Eq.(79) for g s (r). 



5 An explicit example: Argon 

Realistic model interatomic potentials must include a long range weak attraction 
and a short range strong repulsion if they are to predict the properties of dense 
fluids. A popular but by no means unique choice for spherically symmetric 
molecules is the Lennard- Jones (LJ) potential, 



u (r) = 4e 



r < 



r 



(80) 



where the parameter e is interpreted as the depth of the potential well and 
a is the molecular or 'collision' diameter. The reason for choosing this model 
over other qualitatively similar ones is a historical one. It is not that it af- 
fords a particularly accurate representation of the potential but rather that it 
was convenient for analytical calculations at a time when computers were not 
available. 

The main difficulty in solving the integral equations for g(r) and g s (r) is 
immediately apparent. The integrals in Eqs.(|68]) and (|7^) are not defined if 
the potential u(r) diverges as r — > 0. As a quick remedy we modify the short 
range behavior and set u(r) equal to a constant below a certain cutoff dis- 
tance: u(r) = u{r c ) for r < r c . This arbitrary procedure is justifiable whenever 
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the physical predictions are not sensitive to the particular value of r c . This 
is a serious restriction; we find that insensitivity to the cutoff holds for very 
low densities, it fails for even moderately low densities, and under no circum- 
stances can the treatment be extended to liquid densities. This is not totally 
unexpected: behavior at high densities depends crucially on the short range 
correlations neglected in MF approximations. 

First we discuss the iterative solution of Eqs.(|68|) and ( |79| ) for g{r) and g s (r). 
We assume the dilute gas approximation, 

<w(r)=e-**W (81) 

as the initial guess that is substituted into the integrals in the right hand side of 



Eqs.(68) and (|79|). We find that for sufficiently low densities the iterative process 
converges well for both the g(r) and g s (r) and the two agree. For increasing 
densities the solutions develop oscillations of increasingly large amplitude until 
the iterations fail to converge. 

In Fig.|l| we show the dilute gas approximation (DGA) gd, the mean field 
approximation (MFA) g, and the improved mean field approximation (IMFA) 
g s for Argon at n b = 0.00125 A" 3 and T = 150.5 K. The values used for the 
LJ parameters are e = 0.0103 eV and a = 3.4 A (the choice of e and a will be 
discussed below) and the cutoff is set at r c — 2.9 A (the calculation is insensitive 
to changes of r c within a range from about 2.5 to 3.1 A). The temperature 
has been chosen sufficiently low and the density sufficiently high that one is 
already approaching the regime where the iterative solutions fail to converge. 
We find that only within the restricted region n b /kT < 0.16/ A 3 eV the solutions 
converge satisfactorily. 

The somewhat higher peak of the IMFA can be attributed to the fact that 
it partially takes some correlation effects into account. At longer distances we 
find that MFA and IMFA are in close agreement. 

Next we briefly address the two closely related questions of the determination 
of the LJ parameters e and a from experimental data and the overall agreement 
or not of the IMFA predictions with experiment. We will use experimental data 
given in |15| for the equation of state of Argon and for its internal energy. The 
equation of state data are summarized through the coefficients B (T) and C (T) 
in the virial expansion 

l+B(T)n b + C(T)n 2 b + --- (82) 



n b kT 

and data on the internal energy is given in terms of the potential energy per 
particle (U)/N. These data will be compared with the DGA and IMFA pre- 
dictions derived from Eqs.(p2|) and ( |64] ) and with the expression for the second 
virial coefficient given by 
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Figure 1: Dilute gas (DGA), mean field (MFA) and improved mean field 
(IMFA) approximations for the radial distribution function of Argon. 



The generally accepted values of the LJ parameters are those given in 1 15 by 
fitting B(T) at T — 273 K, 

ei = 0.01034 eV and cri= 3.405A. (84) 

In Fig.^Jthe DGA and IMFA equations of state for the parameters e\ and o\ 
are compared with experimental data. The IMFA curve is in sharp disagreement 
with the data. Also shown are the DGA and IMFA predictions for a second set 
of parameters, 

e 2 = 0.01032eV and (72 = 3.151 A. (85) 

The DGA curve fits the experimental curve for low density equally well for cither 
set of parameters, while the IMFA curve for the second set is clearly the best 
match with the data. The difference between the e parameters is not significant. 

On the other hand, as shown in FigJ^ when the DGA and IMFA predictions 
for the potential energy per particle are compared with experiment it is not the 
second set of L J parameters but the first that yields the better match. 

To study this perhaps surprising result from a different perspective we plot 
in Fig|4| the second virial coefficient B at T = 273 K for both the DGA and 
the IMFA as a function of the collision diameter a for e = 0.01034 eV. Our 
calculation shows that there are two solutions for a that match the experimental 
value, and these two values are precisely the o\ and a 2 in Eqs.(pij) and (|S5"|). 

While it is clear that the IMFA is a definite improvement over the DGA a 
number of interesting questions remain unanswered. First, there is the question 
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" b (A" 3 ) 



Figure 2: DGA and IMFA equations of state compared with experimental data 
for two sets of LJ parameters. 




Figure 3: DGA and IMFA potential energy per particle compared with exper- 
imental data for two sets of LJ parameters. 
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Figure 4: DGA and IMFA predictions for B as a function of a compared to 
the experimental value. 

of sensitivity of the MF approximations to the short range part of the potential 
and the issue of convergence of the iterative solutions. Both deserve to be 
studied further. Then, there is the fact that different sets of LJ parameters 
are needed to fit different data. Indeed, we found that different values of e 
and a are needed to fit data at different temperatures. This can be interpreted 
as due to intrinsic inaccuracies in the approximations (DGA, MFA or IMFA) 
employed or, perhaps more likely, to the fact that the Lennard- Jones potential 
is not a good representation of the true interatomic potential. Finally there are 
the inevitable uncertainties in the experimental data which can be considerable 




6 Conclusions 

The method of maximum entropy is traditionally used to assign appropriate 
probability distributions. Here we have explored a different use of the method 
of maximum entropy, as a technique to generate approximations to probability 
distributions that may be intractably difficult to calculate with. We find that 
the resulting variational technique includes the well-known Bogoliuvob varia- 
tional principle as a special case. The extension to other generalized canonical 
ensembles is straightforward and we explicitly show its application to the den- 
sity functional formalism and the derivation of mean field approximations for 
classical fluids. A side result of some interest is a simple proof that the density 
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functional formalism is itself an application of the method of maximum entropy. 

Numerical calculations for Argon gas were compared with experimental data. 
Just as with other mean field approximations, the particular MF versions stud- 
ied here represent improvements over the dilute gas approximation but remain 
restricted to very small densities where particle correlations are small. However, 
as with so many other variational principles the power of the method hinges on 
the right choice of family of trial distributions. Indeed, following the ME-based 
variational approach still has the advantage that the same method can easily 
be used to generate other approximations without these shortcomings. If one's 
interest lies in the physics of denser fluids the next natural step consists in 
choosing a family of trial distributions that provides a better representation of 
correlation effects. 
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